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2. Bayesian Statistical Decision Theory Framework for System Identification 

1. Unknown state of the world denoted by state vector {x(t)}. 

2. A set of models M t , M 2 , with a priori probabilities p(Mj), which describe the 

evolution of the state x(t). 

3. Unknown parameters 0. associated with Model and prior probibilities p(^- 1 Mj) 

4. Vector of observations {y (t)} related to the state of the system {x(t)}, according to 
probability distributions. p({y(t)}| {x(t}, Mj) 

5. Loss function C (M, M) which expresses the loss to the decision maker of choosing 
model M when M is the true model. 
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Bayesian Solution: 


Obtain posterior distributions p(M-| (y(t)}) and select Mb which minimizes the 
expected value of the loss function. 


Bayes Rule: 


p(M. | (y(t)}) = P ( { y ( t ) ) 1 Mj ) p ( Mj ) 

p ( { y ( 1 77) 

payfOJlMj}) = jg p({y(t)}| Mj, $.) p 


Likelihood Function: 


L ( M ,. # ,) = p({y(t)> | Mj.tfj) 
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Maximum Likelihood Estimation 


0 ^ML max i™ zes P({y(0}l or logarithm, LL(0) — log p({y(t)}| 9 ) 


o Cramer-Rao Lower Bound: 

cov (0) > 


e 3LL ( 9 ) f 0LL(0))‘ 

~dl ~TS 


-l 


The quantity in brackets is the Fisher Information Matrix which is very useful for 
determining Identifiability and for Input Design. 

o when p({y(t)} | 9 ) is Gaussian and 9 effects the conditional mean linearly, LL(0) 
is quadratic in 9 and MLE is same as Weighted Least Squares. 

o ^mL can obtained by a sequence of Expectation & Maximization steps 

(E-M Algorithm), each one of which is simpler than direct maximization 
of the Likelihood Function. 

E-step: Estimate state given parameters 
E-step: Estimate parameters given state statistics. 
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Combined Model Structure Determination 
and Parameter Estimation for 
Linear Systems 

x t+l = A x t + B u t + K e t 

y t = Cx t + D u t + e t 

t = 1, ... N 
Stochastic Realization: 

Given {y., u.}, identify system order n and matrices A, B, C, D, K and Cov (e t ) 

t t 

Deterministic Realization: 

Given impulse response parameters CA ^ B, identify A, B, C and n 
Solutions: 

0 Deterministic (Ho-Kalman, Balanced Realization, ERA) 
o Stochastic (Akaike, Mehxa, Aoki, QMARKOV, CVA, SRA) 


QS5 


Stochastic Realization Algori thm 


DEFINE: 

Pj. = column 

fj = column 


. y t-l U t’ y t-2> Vl> ’ 

y t’ y t+l’ y t+2 ] ' 


Past 

Future 


Correlation of Past <k Future: 

H = E (fj P|/)> Hankel Matrix 


Singular Value Decomposition: 


H = UT, V' 
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Identification Results 
1. Membrane Simulation: 

o Data provided by Mark Norris, AFAL 
O Two lightly damped modes at 0.5Hz 
o 5 velocity measurements contaminated with different 
of multiplicative noise (1% to 1,000%). 
o SRA results are satisfactory for 300 % noise' 


levels 
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COND 


WITH NOISE panging FROM 0% TO 
IONS (vTL 1 AND VTL 2) . 


TRUE MODEL: 


erecting: 


DAMPING 


0 Hz 
0.5 Hz 
0 . 5 Hz 

(REPEATED EIGENVALUE) 
MODE SHAPES : 


0 

0 . 01 
0 . 01 


^(X, Y) = i 

<p (x, Y) = cos (n x) 

0 (X, Y) = C0S (E Y) 



TENSION T=1 N/ 
DENSITY p=lXg/ 
a=lm 


membrane sensor locations 
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Free avg 300% noise 150 pts J = 40 K = 20 L = 100 M = 1 N = 



New spectrum calculation 
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ans 


Free avg 300% noise 150 pts J 


ans = 

Magnitude Phase Freq 


ans = 

0.9808 2.3658 3.7655 
0.9808 -2.3658 3.7655 
0.9920 0.3120 0.4968 
0.9920 -0.3120 0.4968 
0.9899 0.3206 0.5105 
0.9899 -0.3206 0.5105 


40 K = 20 L = 100 M = 1 N = 6 


Damping Air Force Values 


0 . 0082 

0 

0 

0 . 0082 

0.5000 

0.0100 

0 . 0256 

0.5000 

0 . 0100 

0 . 0256 

0 

0 

0.0318 

0 

0 

0.0318 

0 

0 


ans = 

Singular Values 


ans = 

1.0000 7.4279 

2.0000 7.4144 

3.0000 2.8451 

4.0000 2.8444 

5.0000 2.2254 

6.0000 2.2090 

7.0000 1.6678 

8.0000 1.6350 

9.0000 1.6062 

10.0000 1.5315 

11.0000 1.5038 

12.0000 1.4938 

13.0000 1.4624 

14.0000 1.4458 

15.0000 1.4098 

16.0000 1.3894 


cyyO = 

Columns 1 through 3 

1. 954 3 67 6887 0000 0e+00 
-9 .8 042 37999 99 9993 e-03 
1. 2222 0488 5 15000 le-03 
1. 715561279090000 e-01 
-4 . 222937015000000e-01 

Columns 4 through 5 

1.715561279090000e-01 -4 . 2 2 29 3 7 0 15000000e-01 

-1. 606591878000000e-01 2 . 431914045500003 e- 02 

66F 


-9 . 804237999999993e-03 
1 . 533202479950000e+00 
-1 . 7 3 5176 744 4 50 OOOe- 03 
-1. 60659 1878000000e-01 
2 . 431914045500003e-02 


1. 222204 88515 000 le-03 

-1.735 17 6744450000e-03 
4 . 806341140050000e-04 

1 . 414021973600000e-03 
3 . 260060618799988e-04 










AFAL Grid Data 


o Data provided by Mark Norris, AF Astronautics Lab 
o Three sets of data at lOOhz. 

(i) PMASS Input (2000 pts) 

(ii) X-TORQUE Input (24,000 pts) 

(iii) Y-TORQUE Input (24,000 pts) 

o SRA identifies all 11 modes in all cases and proivides good estimates of freq., 
dampings and mode shapes. 

o ERA identifies all 11 modes only for combined X and Y Torque inputs 
o Damping estimates from SRA are satisfactory with 2000 pts of P-MASS Input, 
o SRA gives satisfactory identification results with single output. 


8Q>& 


aFal grid 


UiUMlllMLini 


(1) 

(2) 

(3) 

(4) 

1(5) . 

i 

(7) 

(8) 

(8) 

|(») 

(10) 

(11) 

(12) 

(13) 

(14) 

(15) 

(16) 

(17) 

(18) 

(19) 

(20) 

(21) 

(22) 

(23) 

(24) 

(25) 


T 

• X Z - OUT OF PAPER (NORMAL TO GRID) 

NODES (1) - (5) HAVE NO DISPLACEMENT AND NO ROTATION. 
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ans 


Grid avg 100Hz 24000pts J = 60 K - 40 L - 200 M 1 N 22 


ans = 

Magnitude Phase Freq Damping 


Air Force Values 


ans = 

0.9978 1 

0.9978 -1 

0.9987 1 

0.9987 -1 

0.9980 0 

0.9980 -0 

0.9986 0 

0.9986 -0 

0.9986 0 

0.9986 -0 

0.9991 0 

0.9991 -0 

0.9994 0 

0.9994 -0 

0.9993 0 

0.9993 -0 

0.9991 0 

0.9991 -0 

0.9994 0 

0.9994 -0 

0*. 9 9 9 4 0 

0.9994 -0 


.1919 18.9699 

.1919 18.9699 

.1350 18.0648 

.1350 18.0648 

.9013 14.3439 

.9013 14.3439 

.7822 12.4486 

.7822 12.4486 

.7659 12.1900 

.7659 12.1900 

.6813 10.8428 

.6813 10.8428 

.1066 1.6967 

.1066 1.6967 

.0512 0.8142 

.0512 0.8142 

.3986 6.3441 

.3986 6.3441 

.3292 5.2401 

.3292 5.2401 

.2750 4.3775 

.2750 4.3775 


0.0019 
0 . 0019 
0.0011 
0.0011 
0.0023 
0.0023 
0.0018 
0.0018 
0 . 0018 
0.0018 
0.0013 
0 . 0013 
0.0053 
0 . 0053 
0 . 0132 
0.0132 
0.0022 
0 . 0022 
0.0019 
0.0019 
0 . 0021 
0.0021 


0.8100 
1.6610 
4 . 3550 
5.2120 
6.2910 
10.7550 
12 . 1530 
12 . 3840 
14.2540 
17.9550 
18.7720 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


0.0023 
0.0016 
0.0013 
0.0017 
0.0013 
0.0011 
0.0016 
0.0016 
0 . 0019 
0.0015 
0.0010 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


ans = 

Singular Values 


ans = 


1.0000 

2 . 0000 

3 . 0000 

4.0000 

5.0000 

6.0000 

7 . 0000 

8 . 0000 

9.0000 

10 . 0000 

11.0000 

12 . 0000 

13 . 0000 

14 . 0000 

15.0000 

16.0000 


7.4654 
6.0473 
4 .9555 
3.1561 
2.9364 
2 .8078 
2 .4539 
2 .3086 
1.0343 
0.9902 
0.7768 
0.7767 
0.7255 
0.7051 
0. 1895 
0 . 1849 
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ans 


0 In 5 Out 100Hz 2000 ?ts J = 40 K = 20 L - 100 M - 1 N - 26 


ans - 

Magnitude Phase Freq Damping 


Air Force Values Computed Values 


ans = 


0.9853 

1.4770 

23 . 5089 

0.9853 

- 1.4770 

23 . 5089 

0 .0163 

3.1416 

82 . 3967 

0 . 9984 

1. 1810 

18 . 7954 

0.9984 

- 1. 1810 

18.7954 

0 . 9985 

1.1336 

18 . 0411 

0 . 9985 

- 1.1336 

18 . 0411 

0 .9989 

0.9029 

14 .3699 

0 . 9989 

- 0 . 9029 

14 .3699 

0 . 9986 

0 .7821 

12 . 4471 

0 . 9986 

- 0.7821 

12.4471 

0.9972 

0.7675 

12 .2151 

0 . 9972 

- 0.7675 

12 .2151 

0.9985 

0 . 6840 

10 . 8855 

0.9985 

- 0 . 6840 

10 . 8855 

0 . 9982 

0.3981 

6.3367 

0 . 9982 

- 0.3981 

6.3367 

0.9992 

0.3355 

5 .3394 

0.9992 

- 0 . 3355 

5 .3394 

0 . 9993 

0 . 2752 

4 .3797 

0.9993 

- 0.2752 

4 . 3797 

0 . 9992 

0 . 1078 

1.7151 

0 . 9992 

- 0. 1078 

1.7151 

0.9994 

0 

0 . 0099 

0 . 9990 

0 . 0508 

0 .8082 

0.9990 

- 0.0508 

0 .8082 


0 . 0100 

0 .8100 

0 . 0023 

0.0100 

1.6610 

0.0016 

0 . 7948 

4 . 3550 

0 . 0013 

0 . 0013 

5.2120 

0. 0017 

0 . 0013 

6 . 2910 

0 . 0013 

0 . 0014 

10 .7550 

0 . 0011 

0 . 0014 

12 . 1530 

0 . 0016 

0 . 0013 

12 . 3840 

0.0016 

0 . 0013 

14 . 2540 

0.0019 

0.0017 

17.9550 

0. 0015 

0 . 0017 

18 . 7720 

0.0010 

0 . 0036 

0 

0 

0.0036 

0 

0 

0 . 0022 

0 

0 

0 . 0022 

0 

0 

0 . 0044 

0 

0 

0 . 0044 

0 

0 

0.0023 

0 

0 

0.0023 

0 

0 

0.0024 

0 

0 

0 . 0024 

0 

0 

0.0078 

0 

0 

0 . 0078 

0 

0 

1.0000 

0 

0 

0 .0190 

0 

0 

0.0190 

0 

0 


.0019 
.0078 
. 002 ^ 
.0023 
.0044 
.0022 
.0036 
.0017 
.0013 
.0 014 
.0013 


ans = 

Singular Values 


ans = 


l . oooo 

2 . 0000 

3 . 0000 

4 . 0000 

5.0000 

6 . 0000 

7 . 0000 

8 . 0000 

9 . 0000 

10 . 0000 
11.0000 
12 . 0000 


2 . 5860 
2 . 3951 
2 . 3470 
2 . 0355 
1.9648 
0 .2399 
0.2144 
0 .2021 
0 . 1929 
0. 1778 
0.0959 
0.0919 
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X-29 Flatter Flight Test Data 


Data provided by Mike Kehoe, NASA Dryden (33,000 points, 400hz). 
X-29 Flutter modes are excited by natural turbulence 
SRA identifies all the modes from each data channel. 

Damping and frequency estimates in good agreement with NASA values. 
SRA parameter estimates based on 2,000 points are satisfactory. 
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ans 


nasa 3_33 000 rvtfl sO J 


130 K = 70 L = 100 M = 1 N = 14 


ans = 


Magnitude Phase 


Freq Damping Nasa Values 


ans = 


0.6474 
0.9845 
0.9845 
0.9774 
0.9774 

1 . 0000 
0.9941 
0 . 9941 
0 . 9924 
0 .9924 
0 . 9973 
0.9973 
0.9936 
0 . 9936 


0 

0.4328 
- 0.4328 
0 .3760 
- 0 .3760 
0 

0 .2502 
- 0 . 2502 
0 . 1979 
- 0 . 1979 
0 . 1348 
- 0. 1348 
0 . 1694 
- 0 . 1694 


27 . 6811 
27 . 5681 
27 . 5681 
23.9821 
23 . 9821 
0 . 0023 
15 . 9314 
15.9314 
12 . 6095 
12 . 6095 
8 . 5838 
8 . 5838 
10 . 7909 
10.7909 


1.0000 
0.0361 
0 . 0361 
0 . 0606 
0 . 0606 

1.0000 
0.0236 
0.0236 
0.0387 
0 . 0387 
0.0197 
0 . 0197 
0 . 0377 
0 . 0377 


8.5900 
10 . 6400 
12.7900 
15.7200 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


.0182 

.0370 

.0224 

.0286 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


ans = 

Singular Values 


ans ■ 


1. 0000 

2 . 0000 

3 . 0000 

4 . 0000 

5 . 0000 

6 . 0000 

7 . 0000 

8 . 0000 

9 . 0000 

10.0000 

11.0000 

12 . 0000 

13 . 0000 

14 . 0000 

15.0000 

16 . 0000 

17 . 0000 

18 . 0000 

19 . 0000 

20.0000 

21.0000 

22 . 0000 

23 . 0000 

24 . 0000 


60.7314 
41.1338 
38.8540 
23 .9111 
23 . 5237 

5.4193 
5.0483 
4 . 6103 
4 .4074 
3 . 6840 

3 .4194 
1.2080 
1 . 0580 
0. 6707 
0 . 6336 
0.4258 
0.3790 
0 . 3534 
0. 3174 
0.1659 
0. 1548 
0 . 1426 
0.1332 
0 . 1189 


SVG 









BAYESIAN STATISTICAL DECISION TEHORY PROVIDES A UNIFYING FRAMEWORK FOR SYSTEM 
IDENTIFICAION TECHNIQUES. FUNDAMENTAL SIMILARITIES ALSO EXIST BETWEEN 
STRUCTURAL MODE IDENTIFICATION AND EXTRACTION OF SINUSOIDS FROM NOISE. 
(APPLICATION IN RADAR AND SONAR SIGNAL PROCESSING 
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AS SYSTEM ORDER IN INCREASED, FREQUENCIES WITH LARGE SPECTRAL POWER ARE 
IDENTIFIED FIRST. 
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ADAPTIVE CONTROL IS FEASIBLE SINCE MODES WITH DISCERNIBLE SPECTRAL POWER 
CAN BE IDENTIFIED USING SRA. SINCE IT IS NOT POSSIBLE TO DESIGN 
CONTROLLERS, WHICH ARE ROBUST AGAINST ALL POSSIBLE UNCERTAINTIES, ADAPTIVE 

CONTROL OF STRUCTURAL MODES USING ON-LINE IDENTIFICATION IS A MORE PRACTICAL 
APPROACH. 


